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I ntroduct  ion : 

In  this  paper,  we  wish  to  study  a  very  simple  class  of  two 
player,  nonzero-sum  games.  These  will  be  distinguished  by  the  fact 
that  each  player  has  only  local  (not  global)  information  regarding 
the  payoff  functions,  and  made  simple  by  the  assumption  that  each 
player's  strategy  set  be  a  subset  of  the  real  line  R  ,  Thus  our 
analysis  may  be  confined  to  the  Euclidean  plane,  and  certain  tools 
will  be  available  to  us  which  have  no  analogues  in  higher  dimensions. 
Moreover,  we  consider  no  other  solution  concepts  than  Nash  equilibria. 

We  restrict  ourselves  to  such  simple  games,  and  to  a  single 
solution  concept,  for  several  reasons.  First,  the  study  of  non-zero 
sum  games  with  imperfect  information  is  still  in  its  infancy,  and  it 
is  our  belief  that  the  notion  of  a  Nash  equilibrium  point  is  a  highly 
relevant  one  for  such  games.  For  we  suspect  that,  when  faced  with 
imperfect  Information,  people  and  groups  of  people  do  in  fact  attempt 
to  gain  additional  information,  and  then  to  utilize  that  information 
in  roughly  the  manner  we  shall  shortly  describe.  And  second,  we 
hope  that  by  confining  ourselves  to  simple  games,  we  shall  reveal  more 
of  the  nature  of  Nash  equilibrium  points,  the  relationships  which  may 
exist  between  them,  and  the  methods  by  which  they  may  be  computed, 
than  is  possible  by  the  conventional  fixed  point  procedures. 
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We  begin  with  an  example.  Consider  two  firms  X  ar.d  Y  ,  which 
manufacture  toothpaste  Suppose  that  it  costs  r  cents  to  produce 


a  tube  of  brard 

X 

and  s  cents 

for  one  of 

brand 

Y  Let. 

p  be 

the  price  at 

wh  ic  h 

X  offers  its 

toothpaste 

to 

the 

public  on 

a  given 

day,  ar.d  let 

q 

by 

the  price  for 

Y  .  Then 

if 

the 

function 

4-’  be 

defined  for  every  *eal  number  x  by  the  relation 

x  -B--c 

(11)  ;  ( x)  =  •  /  e  dE 

-  oc- 

so  that  0  <  i(x)  <  \Fir  and  $'-xj  \Jv  -  4;x),  we  shall  assume 

that  the  public  demands  m  4-'q-p)  tubes  of  brand  X  during  the  day 
and  mfir  -  m  <t>(q-pj  -  min' p-q)  tubes  of  brand  Y  Here  mfir  is 
some  large  positive  integer,  and  is  equal  to  the  total  number  of 
tubes  of  toothpaste  bought  by  the  public  during  the  day  For  sim¬ 
plicity,  we  have  taker,  this  number  to  be  independent,  of  p  and  q 
That  is,  we  have  assumed  the  public’s  demand  for  toothpaste  to  be 
totally  inelastic.'*'  But  we  do  not  assume  that  the  firms  know  this! 

aem^aerwr 

At  the  end  of  the  day,  the  managers  of  X  will  know  p  , 
because  they  control  it,  ard  their  own  profit 

(1.2)  f(p,q)  =  m(p-r )  *(  q-p)  , 

because  they  keep  books  Also  they  will  know  q  ,  because  they  will 

have  gone  out  and  bought  a  tube  of  brand  Y  But  they  will  not 

■*‘It  has  recently  been  brought  to  our  attention  that  there  exists  a 
considerable  body  of  statistical  data  concerning  such  markets,  and  that 
the  demand  is  more  likely  to  take  the  form:  demand  for  X  4\  log  q/  p )  . 


J 


knov;  Y '  s  profit 

(1-5)  g(p,q)  -  m(q-s)  <t(p-q)  , 


or  (equivalently)  the  public's  demand  for  brand  Y  ,  because  they  do 
not  have  access  to  Y’s  books.  In  short,  x  s  information  at  the 
end  of  a  day  is  entirely  contained  in  the  triple  of  real  numbers 
(p,  q,  f(p,q)),  while  Y's  is  summarized  by  the  list  (p,  q,  g(p,q)). 

But  in  reality,  the  firms  would  never  content  themselves  with 
so  meager  a  knowledge  of  the  market  structure.  For  by  appropriate 
experiments,  they  can  at  least  estimate  the  effects  of  certain  price 
changes.  And  for  simplicity,  we  shall  allow  them  to  measure  exactly, 
certain  quantitites  which  in  practice  they  could  only  estimate  To 
this  end,  we  assume  that  both  brands  are  sold  at  an  infinite  number 
of  outlets  (drugstores,  supermarkets,  etc.)  ...  Then  firm 

X  could,  on  a  day  when  the  prices  were  p  and  q  respectively, 

select  a  subsequence  9,9^,...  of  the  set  of  outlets,  and  reduce 

1  (- 

the  price  of  brand  X  at  those  stores  to  the  levels  p  ,p  ,  .  . 

where  lim,  p  =  p  Then  X  would  know  the  derivative 
K  nk 


(1.4) 


fp(  p,q) 


i.i 


£(pn  ,q)  -  f(P..q 
nk 


P  -P 
nk 


exactly.  And  Y  could  measure  g  (p,q)  by  selecting  some  different 

■  q 

sequence  of  outlets  at  which  to  hold  sales.  Of  course,  they  could 
never  really  hold  more  than  a  finite  number  of  sales,  at  different 
prices,  and  in  suitably  distant  locations  But  since  that  number 


is  large  it  is  felt  that  fp(p,q)  and  gg(p,q)  maybe  regarded  as 
known  We  shall  discuss  various  other  experiments,  which  the  firms 
might  wrsh  to  perform,  a  little  later  on 

In  any  event,  though  they  do  not  know  it,  the  firms  must,  every 
day,  play  the  game 

'  Gi  maximize  ftp.q)  maximize  g(p,q) 

P  <  R  q  e  R 

It  was  shown  in  1]  that  Gj.  has  a  unique  Nash  equilibrium  point 

at  the  intersection  of  the  curves  C  --  {[  p,q):  f  (p,q)  =  oj  and 

P 

P-q):  9q' P-q)  -  o}  c  was  described  geometrically  as  the 

graph  of  a  function  p  =  cp(q)  such  that  y(q)  >  0  ,  cp"(q)  >  0 

and  lim  rp(q)  -  r  .  Similarly,  j  is  the  graph  of  i(p)  where 
q  -*  -.u  / 

^  ’IP)  0  ,  <l»"(p)  >  0  ,  and  lim  *(p)  =  s  Thus  c  and  p 

p  ->  -«p 

are  as  shown  m  figure  1  . 


Figure_l^ 


If  we  replace  h  P_q)  by  $( log  p/q)  in  the  statement  of  our 
problem,  the  curves  C  and  p  still  have  the  shape  indicated  in 
figure  1.  And  since  the  rest  of  our  argument  depends  only  on  the 
shape  of  c  and  r  ,  it  would  be  unchanged  by  the  incorporation  of 
the  more  realistic  demand  function. 


We  may  describe  their  relationship  by  saying  that  the  graph  r  of 

c.osses  C  from  top  to  bottom  as  p  tends  from  -jo  to 

They  do  r.ot  cross  again  since  neither  can  meet  any  line  of  unit  slop 

more  than  once.  Let  P>  be  their  unique  point  of  intersection,  and 

let  ( p* , q* )  be  the  coordinates  of  Pr  . 

We  wish  to  point  cut  that,  using  only  the  ir formation  that 

we  have  allowed  them,  there  are  a  variety  of  ways  in  which  the 

players  X  and  Y  may  be  expected  to  locate  P*  For  instance, 

on  a  day  when  their  prices  are  pQ  and  qQ  respectively,  X  might 

select  a  subsequence  (0.  C  ,  of  the  set  of  outlets  (m  widely 

‘k  i 

separated  communities,  naturally),  and  choose  a  sequence  rp  i!T 

.H-.  K-  1 
1  * 

of  "sale  prices"  which  is  dense  in  the  entire  real  line  In  this 

way,  he  could  locate  the  exact  point  (p^.q  )  at  which  C  crosses 

the  line  q  =  qQ  ,  ar.d  set  his  price  thereafter  at  the  level  p  ^p^ 

But  having  done  so,  X  must  surely  expect  Y  to  reply  m  kind, 

and  reset  his  price  at  the  level  q  -  q^  which  is  optical  for  him 

against  p^  ,  And  if  we  denote  by  P  ,  P^,  P0 ,  ..  the  sequence  of 

points  whose  coordinates  are  (po,qQ),  (p1,qQ),  IP^q^,-..,  it 

is  clear  from  figure  2  that  Inn  P  =  P* 

’  nr. 


Or  at  least  in  the  interval 


Figure  2 


We  note  too  that  the  result  is  the  same  if  Y  is  allowed  to  make 
the  first  move. 

Alternatively,  X  might  wish  to  start,  on  a  day  when  the  firms’ 
respective  prices  are  pQ  and  qQ  ,  by  switching  to  a  new  price  p^ 
which  differs  from  pQ  by  no  more  than  e  .  Accordingly,  we  would 
choose  a  sequence  {p^}  of  sale  prices  dense  in  the  interval 
pQ-e  <  p  <  pQ  +  e  ,  and  take  p^  to  be  the  price  which  optimizes 
f(p,q  )  thereon.  And,  not  unreasonably,  Y  might  then  switch  to 
a  price  q^  which  maximizes  g(p^,q)  over  an  interval  qQ-£,  <  q  <qQ+?>. 
The  sequence  p0,pl, obtained  in  this  way  is  indicated  in  figure  3. 


3  3 

The  sequence  Pq,  Pq,  P3,  .  .  .  is  the  variant  of  PQ,  P^,  p^ . 

obtained  by  using  Je  instead  of  e  .  Rather  clearly,  the  process 
does  converge  for  any  pair  of  positive  numbers  e  and  R  .  And 
again,  the  result  is  independent  of  which  player  is  allowed  to  make 
the  first  move.  In  what  follows,  wc  shall  refer  to  the  process  of 
figure  2  as  the  long-step  process  (  tt  )  ,  and  that  of  figure  3 
as  the  short-step  process  (  tt  )  .  We  shal]  also  consider  an  mfin- 
tesimal  process  (  tt  )  first  suggested  by  Rosen  f  3  ] ;  namely  that 
the  players  change  their  prices  simultaneously  and  continuously  in 
time  according  to  the  laws 

P(t)  =  fp(p(t),  q(t)  ) 


(1-5) 


q(t) 


qq(p(t),  q(t)  ) 


-  6  - 

For  completeness,  we  sketch  the  solutions  of  the  ordinary  differential 
equations  (1.*)  near  P*  in  figure  !+ , 


Figure  h 


All  the  solution  curves  (p(t),q(t)),  -«  <  t  <  «>  ,  approach  P* 

as  t  — >  +  oo  ,  and  all  save  the  one  labeled  72  are  tangent  to 
the  single  solution  curve  7^  .  This  state  of  affairs  may  be  sum¬ 
marized  by  saying  that  the  singularity  P*  of  the  system  (1.5)  is 
a  "stable  node".  We  will  have  more  to  say  about  the  singularities 
of  systems  like  (1.5)  later  on. 

Finally,  we  observe  that  if  r=s  ,  the  equations 

-fp(P>q)  =  (p-r)  ®'(q-p)  -  «(q-p)  =  0 

(1.6) 

-gq(p,q)  =  (q-s)  ®'(q-p)  -  ®( p-q)  =  o 

have  a  symmetric  solution  p*  =  q*  ,  to  be  found  by  solving 


(1  7) 


(  p - r  '  •  0  )  :;p-r 


■'  0) 


for  p*  r  x  -Jti/Zc  qk  .  And  the  solution  of  \1.C)  is  unique 

for  all  values  of  r  and  s  .  Thus  at  equilibrium  the  profit  on 
a  tube  of  toothpaste  is  \T rr;  2  c  cents.  And  if  we  recall  that  the 
public's  demand  for  brand  X  on  a  day  on  which  p  =  q  h  is 
m  4(h)  *  md!  0)  •*  m  h  4 ' '  0)  =  mV7?/ 2  *  m  hr  ,  it  is  clear  that 

met  is  just  the  number  of  sales  lost  by  firm  X  if  they  charge  a 
penny  (h-1)  more  for  their  product  than  does  firm  Y  .  So  if  the 
market  is  highly  sensitive  to  small  changes  ir.  price,  r  is  large 
and  profits  are  small  But  if  it  is  ir.sens itive,  then  profits  may 
be  very  high  indeed 

Of  course,  if  e  is  too  large,  the  firms  will  not  likely 
accept  a  profit  of  only  s/tt/ p <7  cents  a  tube.  They  do  not  have  to 
because  both  f  and  g  are  increasing  functions  along  both  C 
and  r  Thus  one  firm,  say  X  ,  may  choose  a  price  p  greater 
than  pA  ,  the  equilibrium  price,  ar.d  allow  Y  to  maximize  its 

own  profit  against  p  .  Then  the  firms  would  find  themselves 

operating  at  a  point  P  to  the  right  of  Pv  on  r  ,  at  which  they 
both  earn  higher  profits.  And  perhaps  they  car.  even  negotiate  a 
compromise  P'  above  P  'but  below  C  )  at  which  their  relative 
shares  of  the  market  are  more  nearly  equal.  But.  the  a-swers  to  such 
questions  go  beyond  the  theory  of  Nash  Equilibria,  and  we  shall 
not  discuss  them  here  For  it  is  our  belief  that,  cor  fronted  with 

the  market  described  above,  firms  really  do  behave  much  as  we  have 

said  they  would,  and  arrive  at  Nash  Equilibrium  rices. 
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Initially,  we  shall  confine  our  attention  to  the  class  of 
"concave  games"  defined  on  the  entire  Euclidean  plane  R  x  R 
Such  a  game  is  completely  determined  once  we  have  specified  the 
payoff  functions  f(x,y)  for  player  X  and  g(x,y)  for  player 
Y  .  To  play,  player  X  chooses  a  "strategy"  x  c  R  ,  player  Y 
chooses  y  c  R  ,  and  the  "bank"  (the  toothpaste-buying  public, 
in  our  example)  pays  f(x,v)  dollars  to  X  and  g ( x , y )  dollars 
to  Y  . 

We  shall  assume  that  f  and  g  are  at  least  tv/ice  continuously 
differentiable  throughout  R  X  R  .  Also,  we  shall  assume  that 
f(x,y)  is  bounded  above  on  each  line  y  =  constant,  that  fx(x,y)  -  0 
holds  at  a  unique  point  (cp(y),y)  on  that  line,  and  that  f  (x,y) 

AA 

is  negative  everywhere.  Similarly,  g(x,y)  must  be  bounded  above 
on  point  (x,  y( x ) )  on  that  line,  and  gyy(x,y)  must  be  negative 
everywhere.  It  then  follows,  from  g  ( x,  i|/(x))  =0  ,  that 
\|f  '  (  x )  =  -gx^(  x>  ^(x))  i-s  we^  defined  and  continuous 

on  the  whole  real  line,  and  that  because  the  denominator  is  never 
zero,  the  graph  of  the  function  y  can  never  be  tangent  to  any  line 

x  const.  Similarly,  the  graph  of  cp  can  never  be  tangent  to  a 

line  y  const. 

A  strategy  xq  for  X  is  said  to  be  "rational  for  X"  against 

a  particular  strategy  yQ  for  Y  if  f(xQ,yo)  >  f(x,x^)  for  every 

x  /  x  .  And  the  curve  C  {(x,y):  f  (x,y)  =  0}  is  called  the 
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"rational  curve”  for  X  .  Similarly,  r  =  {(x.y):  g^(x,y)  -  0} 

is  called  the  rational  curve  for  Y  .  Any  point  (x,y)  in  their 
intersection  is  rational  for  both,  and  is  said  to  be  a  Nash 
equilibrium  point  of  the  game 

(G)  maximize  f(x,y)  Maximize  g(x,y) 

xeR  ytR 

That  is,  if  (X0^Y0)  ls  i-n  k°th  C  and  r  ,  then 

(2.1)  f  (  x0  ’  Yq  )  >  f  (  x;  Yq)  and  g(xQ,yo)  >  g(xQ,y) 

for  every  other  point  (x,y)  in  RxR.  We  assume  that  C  and  r 
meet  at  only  a  finite  number  of  points, 

1  2 

They  need  not  meet  at  all.  For  if  (example  1)  f  =  xy  -  ^  x 
and  g  =  (x+l)y  -  ^  y  ,  then  fxx  =  -1  =  g  ,  C  is  the  line 
x  =  y  ,  and  r  is  the  line  y  =  x+1  .  On  the  other  hand,  they 

may  meet  any  finite  number  of  times  For  if  (example  2),  f  is 

12  1  2 
again  equal  to  xy  -  -  x  ,  and  g  =  ( x +p( x ) )y  -  ^  y  ,  then 

f  =  -1  =  g  as  before,  C  is  still  the  line  x  =  y  ,  and  r 

becomes  the  graph  of  the  polynomial  x+p(x)  .  So  if  p(x)  = 

=  ( x- 1 )( x-2 ) . . . (x-n)  ,  r  crosses  C  at  each  of  the  points 

(1.1) ,  ( 2, 2 ) , . . . , ( n, n) ,  and  nowhere  else.  The  interesting  questions 
in  the  theory  of  planar  concave  games  concern  not  the  location  of 
the  Nash  equilibria,  but  the  various  types  of  stability  which  they 
may  have , 


1 


PiGite_Stabi 1  i  t ^  _9i  _the  Nash  Equilibria 


We  sr.all 


co- sider  the  lo-a-step  process  *  first  The  process 

Ij 


?r  ( x  i  start  1  g  from  the  pci.-.t  P  ,  whose  coordinates  in  RxR  are 

yQ.y  ,  ar.d  in  which  player  X  is  allowed  to  move  firs*  ,  may  oe 

defined  inductively  as  follows:  w  f X )  is  -hat  sequence  P  ,P,,  ... 

ti  o  l 

of  points  lr.  the  pla;  e  '  having  the  coordinat  es  '  VD)  •  •) 

for  which  i  13  tne  (unique)  intersection,  of  the  line  /  =  y  ^ 

with  C  ,  for  every  k  =  0  1,  ..  ,  and  for  which  p£k  -  ls  tne  'also 
unique)  intersection  of  the  line  x  =  x..^  +  ^  with  r  The  process 
~  (Y;  is  defined  analogously 

Lj 

It  is  clear  from  our  example  in.  §1,  that  Doth  v (X;  ar.d 

Li 

tr  (Y)  may  converge  from  every  starting  point  i%  x  ,y  }  in  RxR  to 
the  same  equilibrium  point  ' x*  y*)  of  the  game  G  But  this  reed 
not  be  the  case  For  if  (example  h  )  the  polynomial  p(x)  in  ex¬ 
ample  2  were  just  p'x)  =  x,  r  would  be  the  lire  y  =  2x  ar,d,  as 


indicated  m  figure  c)  ,  the  sequences  rr  all  diverge  to  <* 

Li 


Figure^ 


15 


Here  the  points  p^p^.p^,  •  form  the  sequence  f^v  X) ,  while 

P  .,P',P'  ...  form  w  (y)  .  We  note  that  the  two  sequences  diverge 
not  only  from  the  unique  Nash  equilibrium  point  0,0>  of  tne  game, 
but  also  from  each  other.  indeed  direct  calculation  reveals  tnat, 
for  the  game  defined  oy  the  payoff  functions 

(3*1)  f  •■=  j  a  x“  +  bxy  -  FV  y )  and  g  =  |  m  y‘  *  Pxy  -  G(  x)  , 

where  a  =  f  and  a  =  g  are  regative  numbers  and  F  and  G 
xx  V* 

are  arbitrary  functions,  the  sequences  f_  i  x  )  a^d  t  (Yj  both 

Ll  Li 

converge  to  the  origin  from  any  PQ  ^  (0,0),  wherever  the  ratio 

b3/aa  is  less  than  one  m  absolute  value  (i.e.,  j bp |  <  aa)  ,  and 

diverge  to  *  if  it  is  greater.  if  bp/acr  =  1  ,  tne  sequences 

are  both  periodic,  since  Pq  =  1*^  =  ,  for  every  starting  point 

P  .  If  bp/aa  =  +  1  ,  r  ar.d  C  coincide, 
o  ' 

The  situation  is  more  complicated  still  if  we  consider  functions 
f  and  g  which  lead  to  curved  paths  C  and  [  .  For  instance  ( example  5) 
if 

(5.2)  f  =  xy1/5  *  (1/2)  x2  g  -  (x5  5xjy  •  y^  , 

1/5  * 

C  and  r  are  the  graphs  of  x  =  cp\  y )  =  y  ' J  and  y  -  ♦ix)  =  (x'  ■  J)/2 
respectively.  Then,  as  indicated  in  Figure  6,  the  square  with  corners 
x  -  +  1  ,  y  =  +  1  is  invariant  under  the  process  w  ,  and  the 
process  paths  starting  both  within  arid  without  the  square  converge 


to  it. 


Finally,  in  games  with  multiple  equilibria,  the  process  ir 

L 

may  be  convergent  but  ambiguous,  in  the  sense  that,  from  certain 
starting  points  ir (x)  and  tt  (y)  may  converge  to  different 

o  1j  Li 

equilibrium  points  P*  and  P**  Thus  if  (example  4) 


(5-5) 


f  =  xy  - v 1/2'  xc 


and  g  =  x1'-5  y  -  (1/2)  , 


the  points  P*  =  (1,1)  and  P**  -  (1,-1),  as  well  as  the  origin, 
are  Nash  equilibria  And,  as  ar.  examination  of  Figure  7  will 


in  the  second  and  fourth  quadra;  ts,  while  v  f  Y;  qoes  to  P**  . 

Li 

Both  procedures  lead  to  Pv  if  Po  is  lr  the  first  quadrant  and 
to  P**  if  pq  is  1  r  the  third  The  origin  is  a;  ur stable  equili 
bnum  in.  the  sense  that,  only  if  PQ  lies  or.  a  coordinate  axis,  does 
even  one  of  the  sequences  ^  (X)  ar d  r  y  lead  there 


To  fix  ideas  we  say  an  equilibrium  point  p*  is  L-stable  if 
there  exists  a  .neighborhood  N  of  P*  such  ’-hat  start  lrg  from  a'  y 
P  cN  both  7T  (x)  and  v  ( \ )  converge  to  P‘  Without  loss  of  gene- 
rality,  we  may  take  the  equilibrium  point  P*  under  consideration  <o  be  t 
origin.  We  shall  show  below  that  0  is  L-stable  if  for  some  r  >  o 
(  3  ••  M  !  <p(  i|r ( x) )  |  <  |X  for  0  i  x  I  <  - 

or  equivalently,  if  for  some  >  o 
(3-5)  U'(cp(y ) )  I  <  I  y !  for  0  <  !  y 1  n  - 

in  particular  0  is  L-stable  if  I  q>  ■  '  0 )  b  (0  1  and  is  L-unstable 

if  |  cp  ’  (  0  )t  '  (  0 )  |  <  1  Geometrically  tms  condition  states  that  0  is 
L-stable  if  the  slope  of  r  at  O  is  less  m  absolute  value  than  that  ot 
C  ,  and  is  L-ur, stable  it  it  is  greater  If  C  a-d  p  are  straight  lines 
the  neighborhood  N  can  be  taker,  as  the  entire  plane 


With  curved  rather  a)  curves  C  and  r  ,  there  exist  isolated 

points  from  wnich  '.'X;  cr  'V  converge  to  L -’instable  eauili- 

L: 

brii  ir.  a  finite  r.^mter  of  steps  For  example,  in  Figure  6  starting 

frem  toe  pci-t  0  ah  whicn  ,  intersects  the  positive  x  axis, 

X  converges  to  the  origin  i.  ore  step  and  ir.  two  steps. 

Hence  starting  from  ary  point  from  which  Q  is  reached  m  a 

finite  number  of  steps,  n  converges  to  the  origir.  Moreover,  the 

Li 

set  of  all  Q„  is  urDOur.ded. 

0 


In  study i  g  the  concept  of  L-stability  m  a  global  sense,  we 
shall  war.t  to  exclude  such  isolated  points  T  erefore,  giver,  that  0 
is  an  L-stable  equilibrium  we  seek  the  largest  set  M  of  points  from 
which  both 

lies  entirely  ir  M  ;  that  is.  each  lire  segment  joining  and  P^  ^ 

must  lie  ir.  M  We  shall  call  M  the  convergence  reqior  of  wT 
The  following  theorem  characterizes  the  convergence  regie.'.  M  . 


1  X)  and  'r  y  converge  to  0  through  a  path  which 
L  Li 


"THEOREM^  Let  0  be  an.  L-srable  equilibrium  Then  there  exists 
a  unique  open  rectagle  M  for  which: 


■  a)  t  ;  X )  and  rr  y  )  converge  to  0  from  ar.y  point 
Li  L 

PQ  M  through  a  path  lying  wholly  in  M  ,  and 


b ) 


From 

ar  y  f  l 

r.  i  te 

vertex 

of  M 

either 

;  1  ) 

vx) 

and 

"l '  Y  ' 

both 

cycle,  or 

;  2 .) 

vx) 

a.n  d 

V  y 

bot.h 

converge  in  at  most 

three  steps  to  an  L-ur stable  equilibrium 
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Moreover,  M  is  the  largest  set  having  property  (a).  in 
particular,  M  is  the  rectangle  determined  b>  ;  xQ,  Vq  ) ,  ' x0-'^i ) 
(x^^Yj)  ar.d  ar.d  ( x1 ,  y  )  where 

x  =•  sup x*-0:  cp' v{  cp' v' x  )  )  )  ;  =  x  or  o(  ^  x  )  )  )  '  =  rp(  x )  j  /O) 

xx  =  ir  f (x>0:  rp'  v'  "A  x) )  : ;  =  x  cr  cp>  o'  v(  x)  ;  )  \  =  cp(  y(  x)  )  /  0  ; 

(3-6) 

yQ  -  sup  y<0:  ♦(  cp{  ?'  o(  y ) )  ; )  =  y  or  f '  <p(  *(  cp(  y ) )  )  )  =  K  cp(  Y  )  j  /  0 

y-,  =  sup(y>0:  v(  cp(  y( cp(  y ) ) ) )  -  y  or  <r(  <p(  v '  cp'  y ) ; )  J  =  *(  cp(  y )  )  4  0 

The  proof  of  the  thoerem  involves  the  following  lemma  whose 
proof  appears  in  the  Appendix. 

LEMMA:  Let  h  be  a  continuous  function  for  which  h(0)  =  0 

and  for  some  -  >  0 

(3-7)  0  <  i  1 1  <  =>  |h(  t )  I  <  !  t  i 

Let  tQ  be  the  largest  negative  t  and  t^  be  the  smallest 
positive  t  for  which  either  h  (h(t))  ^  t  or  h(h(t))  =  h(t)  40 . 
Let  i"  =  (  tQ , 0 )  ,  I4  =  (0,t1),  and  I  -  (t^t^.  if  h'n  ) 
represerVs  the  r. -fold  composition  of  h  with  itself,  then 


(i1) 

t 

»  rr  1 

c  I  =o>  h  1  ( t ) 

<  t  , 

tel  ==>  hL°  (  t) 

t 

(ii) 

h 

maps  the  pair  | 

ro^il 

into  itself, 

(  iii) 

t 

.  [nj 

e  I  =>  n  cl 

,y 

(iv) 

t 

e  I  =>  lim  hin 

T  or 

J(t)  = 

0  . 

.  1 M  - 

To  prove  the  theorem  we  note  first  that  the  successive  points 
of  rL(  Y ,  from  PQ  (x.y)  are  =  (x,<|/(x)),  P,  =  (cp(4'(x)),  i|f(x) 

P  !  (  x)  ; .  4  (  ( (  4  (  x  ) )  )  ) ,  ..  .  Hence  (3.4)  or,  equivalently, 

(3.‘  )  is  necessary  and  sufficient  for  0  to  be  L-stable.  Now  let  M 
be  the  open  rectangle  of  the  theorem  and  Pq  =  (x,y)  e  M  .  That  the 
abscissas  of  belong  to  (xq,x^)  a:.d  converge  to  0  follows  by 

applying  parts  (iii)  and  (  iv)  of  the  lemma  with  h  =  cp(t).  (We  note 
that  (3.4)  and  (j.n)  imply  that  "sup*'  and  "inf"  in  (3-6)  can  be  replaced 
by  "max"  and  "min’  respectively,  and  hence  always  exist,  although  they 
may  be  infinite  )  To  show  the  ordinates  belong  to  (y  ,y^)  we  first 

show  that  yQ  <  rp(x)  <  y^  ;  in  fact  for  every  x  e  (xq,x^)  we  must 

have  v(x)  r  (y0<Yy)-  For  suppose  ty(x)  =  y^  for  i=0  or  1  so  that 

?(  V(  cp(  V(  x)  )  )  ))  =  4(x)  or  «|f(  cp(\K  cp(<|r(x) )  ) ) )  =  <K cp('|r(  x)  )  )  /  0  .  Then 

cp(  v(  <pU(  q>(x)  )  )  )  )  =  cpU(x))  or  cp(  \|r(  <p(  q>(  t(  x) )  )  )  ))  =  cp(  i|r(  cp(  \|r(  x)  )  ) )  . 

Hence  either  h(x)  <f  I  or  h(x)  =  0  .  The  latter  possibility  can  be 
eliminated  since  cp(y^)  =  0  contradicts  the  definition  of  y^  . 
Therefore,  by  part  (iii)  of  the  lemma,  x  j.  I  .  Applying  the  lemma 
with  h  =  ty(cp)  we  have  that  the  ordinates  of  P^  belong  to  ( y  >  Yf ) 
and  converge  to  0  ,  A  similar  argument  holds  for  tt  ( X)  and  part  (a) 
is  proved  The  proof  of  part  (b)  is  elementary.  That  M  is  the  largest 
such  rectable  follows  from  part  (b)  since  a  continuous  path  from  any 
point  outside  M  to  the  origin  must  intersect  the  boundary. 

An  example  in  which  (b-1)  obtains  is  the  game 

f(  x,  y )  =  xy  -  x  g(  x,  y )  =  -y2  -  xy  -  x3y 


(  3  •  ri  ) 
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in  which  C  is  the  graph  of  x  =  cp(y)  =  y  and  r  is  the  graph  of 

“X  2 

y  =  f(x)  =  —  ( 1+x  )  .  The  origin  is  L-stable  and  the  convergence 
region  of  i t  is  the  open  rectangle  with  vertices  (+1.+1).  (b-2) 

obtains  in  any  game  for  which  a>  and  v  are  either  both  increasing 
or  both  decreasing.  This  situation  is  exemplified  by  the  game  (5.3) 
and  illustrated  in  Figure  7,  The  points  P*  and  P**  are  L-stable 
equilibria  with  corresponding  convergence  regions  M*  ,  the  first 
quadrant,  and  M**  ,  the  third  quadrant,  In  the  second  and  fourth 
quadrants  tt^  is  ambiguous.  If  cp  and  t  are  either  both  increasing 
or  both  decreasing  and  there  are  multiple  equilibria  at  which  C  and 
r  actually  cross,  then  moving  along  either  curve  the  L-stable  and 
L-unstable  equilibria  alternate  and  the  L-unstable  equilibria 
partition  the  plane  into  a  "checkerboard"  of  rectables;  each  "black" 
rectangle  is  the  7 rL  convergence  region  of  an  L-stable  equilibrium, 
while  from  the  "white"  rectangles  ir  is  ambiguous. 

li 

The  short -step  processes  have  rather  more  satisfactory 

convergence  characteristics,  both  in  the  sense  that  they  sometimes 
converge  when  the  corresponding  long-step  process  does  not,  and  in 
that  they  reduce  the  size  of  the  set  of  ambiguous  starting  points  p  , 

A  particular 

short-step  process  7r  (x ;  e  ,8)  may  be  defined  inductively  as  follows 

O 

7 r  (X;  e,&)  is  that  sequence  of  points  P  , (with  coordinates 
s  ox 

(xo,yo),  (XpYi),..-  )  in  RxR  for  which  is  the  (unique) 

solution  of  the  problem 

* 


0 


max • mi ze 
x 


subject  t  u  x 


x  v.  x  „ 
2  k 


i  i- 


k  • 


is  the  also  ur. lque  solution  of 


10 


maximize 


g  x 


k  •  1 


subject  to 


-  *’ 


yik-l 


and  for  which  x 


?k 


X  )k  •  1  a:  d  y  2k  - 1  =  Y2k 


for  each  k=0 , 1 , 


, .  Y ;  •  ;  may  be  similarly  defined  Now  let  L^,  be  the  horizontal 


centered  at  P^.  If  L0,  contains  a 
zk  2  k 


line  segment  of  lenth 
point  of  C  then  that  point  is  1  .  Otherwise  P^^  ls  the 

endpoint  of  wnich  is  closer  to  C  .  And  if  the 

vertical  line  segment  of  length  .b  about  +  P2k-2  1S  t^ie  P°int 


Oi 


1 

^k  t 


k  *  1 


nearest  to  i 


Locally  it  ar  d  rr  are  identical  m  that  P*  is  L-stable  if 

O  Ju 

and  only  if  it  is  S-stable  Ad  if.  as  m  the  games  (*  1),  C  and  r 
are  straight  lines,  then  local  stability  is  equivalent  to  global 
stability  for  either  process.,  Indeed,  if  we  define  a  convergence 
region  for  it  as  we  did  for  tt  (a  set  M  of  points  from  which 
the  process  converges  to  a  given  stable  equilibrium  thru  a  path 
lying  entirely  in  M  ),  it  is  clear  that  the  convergence  regions 
would  be  identical 

Hence ,  for  fixed  and  6  ,  let  us  define  tne 


region  Mc  of  .r  with  respect  to  a  giver.  S-stable  equilibrium  P* 


from  which  the  processes 


-  '1 

to  be  merely  the  set  of  points  PQ 
7T  '  X:  -  ,  :  )  ard  ”  '  y ;  ,  ;  both  c0r.ven.3e  to  p‘  Then  if  7  and 

O  O 

*■  are  both  increasing  or  both  decreasing,  tne  convergence  region 
Mc  of  v  contains  the  co'vergerce  reqion  M  of  For  m 

,  the  paths  of  t  are  mor.ctone  toward  0  ,  and  car  rot  end  at 
any  point,  other  than  an  intersect  10:  of  ar.d  C  but  Mg  may  be 
much  larger  than  Mr  For  i.nstar  ce  if,  m  the  game  ' j.  illustrated 
by  Figure  7  ,  we  choose  -  5  very  small,  the  region  Mg  corres¬ 
ponding  to  P*  is  approximately  the  half -plane  x  •  y  >•  0  ,  wmle 
that  corresponding  to  P**  nearly  fills  the  regicr  x  -  y  <  0 

1 _ Inf initessimal  Stability 

The  process  ir ^  starting  from  the  point  PQ  .  whose  coordinates 

in  RxR  are  (x  y  ),  may  be  defined  tc  be  the  solution  xt),y(t); 
o  o 

t  <  0  ,  of  the  ordinary  differential  equations 
x(t)  -  f  (x(t),y(t); 

(4  1) 

y(t)  =  g  (x(  t)  ,y;  t) , 

for  which  x(0)  =  xq  and  yfOj  =  yQ  Clearly,  since  we  assumed 
f  and  g  to  be  at  least  twice  continuously  differentiable,  there  is 
only  one  such  solution.  And  if 

lim  x(t)  =  x*  and  1 1m  y ' t !  =  y* 

t— *  OU  t  «> 

for  every  pair  (x0^yQ)  some  neighborhood  of  x* , y* ) ,  we  shall 

say  that  the  equilibrium  point  ( x* , y* >  of  the  game  G  is  '  I-stable' 


For  the  games  '  ••  1  tee  equations  (  1)  reduce  to  the  linear 


cqua?  ions 

x  ax  by 
V  x  -  >y 

sc  that,  tne  origin  0  is  the  or.ly  equilibrium  point,  and  it  is 
I -stable  if  ar.d  only  if  both  roots  of  the  characteristic  equation 
'  see  ,  pp  ‘v>  ) 

*> 

=  \  -  (  a  1  a  )  k  )  (  a  x  -  b>r  )  =  0 

nave  negative  real  parts  But  the  roots  of  vu  l)  are  just 

'  •  )  \  -  [  a  i  a  \f{a-ot)2  t  4  bp  ) 

where  the  radical  denotes,  as  usual,  the  positive  square  root.  So  if 
the  qua^ti.  ier  the  radical  is  l.ot  positive,  both  roots  have  the 

real  part  (  aint)  >2  ,  which  is  negative  because  f  =  a  and 

XX 

g  a  are.  And  if  that  quantity  is  positive,  both  roots  are 

real,  the  smaller  one  is  always  negative,  and  the  larger  one  is 
also  negative  when,  at  >bp,  zero  when,  ace -bp  =  0  ,  or  positive  when 
an:  v  bp  In  short,  0  is  I -stable  if  aa  >  bp,  or  equivalently, 
iff  cp  [ 0 j  i  '  0)  <  1  Geometrically,  1-stability  requires  either 
that  C  and  f  lie  in  different  quadrants  or  that  the  slope  of  r 
be  smaller  in  absolute  value  than  that  of  C  ,  If  A  =  aa  -  bp  =  0  , 
C  and  r  coincide  and  there  are  infinitely  many  neutrally-stable 
equilibria  a  possibility  we  do  not  wish  to  discuss 


f  O 


b 

r  -  \ 


The  ongir.  may  be  1-stable  for  the  games  (3  1)  without  beirg 
either  L -stable  or  S-stable  (as  is  the  case,  for  example,  wher.  a  =  a 
and  b  =  -p  =  2 ) .  But  L-stability  ar.d  S-stability  always  imply 
I-stability  since  b-  <  j  Dp  (  This  is  o.r.e  reason  for  our  cor.victio 
that  I -stability  is  a  mere  fundamental  concept  than  the  other  two 
We  point  out  that  if  0  is  I -unstable,  it  is  a  saddle  point"  of 
the  system  ( P  3),  ard  the  solution  curves  have  the  form  indicated  in 
f igure  8 . 


Figure 


The  rays  7  +  and  y~  are  straight -line  solutions  of  (  P , J )  which  are 
directed  away  from  the  origin,  ar.d  are  called  (see  [  P  ] ,  pg  PI r) 
separatrices..  The  other  pair  of  straight-line  solutions  are  called 
separatrices  also,  and  are  directed  toward  the  origin.  Observe  that 
the  lines  C  and  P  divide  the  plane  into  four  quadrants,  and  that 
each  quadrant  contains  exactly  one  separatnx.  In  particular,  in  the 
case  we  have  shown,  C  ar.d  r  have  positive  slopes,  so  the  outward- 


r  on 1  !  s  i :  a  •  1  .  3  m  ■>'  i  :  •  :  t  c-  !  1  :  •»  *  a.  a  :  n  >  ;  d 

q  a  ::  j  *  o  .  :  e  >p  '•  :"e  t .  W  i  mart--  '  •.  i*  1  o  .1i  /  i  g..  l  »•  ed  sc  l..-  iors 

7j  -i  :  .  ir  also  •  ille:  aeparatric  s.  ad  are  all 

i  *  i  o  t  ■-  a  *  >-ii  :  a  :  s*  *  "  •  _  :  i  g  t  Sepaiatncea  pla,  an  inpor  t  a'  - 1 

:  o  1  *  .  '■  i  i  l.s  a  o'  a’.  ji:*'<  »•.  al  3'.  »?  eir.s  o'  'Tlr.ai  ,  different  lal 

q  -s'i  c  v  ■  u  'is  -  *.v  5i  "el  .  ..  Le*  » •;•.«=»  ?  ir  c:  dpt  et  a  X 

a  :  1 X  ' 

I:  0  :  1  -T.ut.le.  .  t  -a  ;  e  -lt.ai  a  s'aole  •  ode  two  regal  i-,c 

teal  t  .  a.  t  j  as  s*  . «  i  '.a  re  ct  a  spual  poir.t  complex  jocts 

1  *■.  la’  'ot  :ase  ‘  :  e  scl.r;:.  s  c '  -  -•  are  logari  t  v'mic  spnals 
w  .  i  appt  ;;a  ••  f c:  :.:i  ds  _  mp'  o*  t  ■  a  1 1 ;  as  *  becomes  infinite 

A  *  ca  simple  a=,?s  deserve  me  'to  It  for  i:  o;a:.ce,  we  relax 

o.r  r.  j  pc  •  teses  temp  r  a  r  « l  /  tc  allow  a  F.  a- a  G  all  to  varnish. 

1  oe  comes  t  re  aimpK-s'  example  of  a  no-  zet  o  •  s.m  game  wi'h  bilir.ear 
payoffs  Toe  c.oaract  er  is*  .  r  eq-a'  u.:  -  •  te.r.ces  to  %  =  bp  so 

tr.at  tne  crigi;  ma,  be  eitrer  a  saddle  poire  i  •'  bp  >  0;  or  a  "cer  ter' 
if  t>  0  r.  toe  lat'et  rase ,  toe  sol.  •  ic;.s  of  ;  ■  ate  ellipses 

cetered  a'  0  ,  wrier.  t.as  o-  1>  .etral  st  ar-ili’,.  Or  it  p  -  •  b, 

tne  games  1  are  east  '.all,  zero -s.m  For  t:  s:  the  eq  .at  ions  -f .  s ; 
are  o  t  t : e  form 

x  ;x  x..  a;.d  y  -  •  1  ^  x ,  y  ;  , 

a- d  tticir  sol  .tic  s  mat  oe  expected  ’o  lead  to  a  mioimax  poi.  t  of  the 
game 

max  ru -  :  x ,  y 

x 

w.oere  f  is  j-st  ax  tx  •  Indeed,  hnis  expectation  is 


realized,  because  p  =  -b  implies  that  the  characteristic  function 
(h  1 }  is  positive  when  k  -  0  and  roots  must  both  be  either  real  and 
negative  or  complex  with  negative  real  parts  In  either  case  the 
origin  is  a  stable  equilibrium  per  t  for  the  system  v  u  .  3  )  . 

Finally,  if  a  0  -  a  and  o  =  1  - b,  we  are  left  with  the 

classical  pe.cn/  matching  game,  whose  matrix  is 


\*! 

X  -  >v 

-i 

-i 

•  i  , 

•  i 

j 

1 

-i 

At  each  play  of  the  game,  tine  placers  X  ar.d  Y  decide  whether  to 
play  heads  or  tails  Then  they  reveal  their  choices  to  the  referee. 

If  they  both  have  made  the  same  choice,  he  awards  X  s  penny  to  Y  , 
but  if  they  have  chosen  differently,  he  gives  Y  s  pern,  to  X  .  Here 
x  and  y  are  strategy  mixtures  for  X  ar.d  Y  ,  the  values  1  and  -1 
corresponding  to  the  pure  strategies  "heads'  and  "tails'  respectively. 
Ar.d  the  game  has  the  single  minimax  pair  x  =  0,  y  0,  at  which  both 
players  play  either  heads  or  tails  with  equal  probability. 

But  our  players  would  .'.ever  discover  the  -  by  the  procedure  t t 
For  the  solutions  of  ( f  3)  are  now  give.,  by 

(x(t)\  /  cos  t  -  sin  t  \  ,/x  \ 

)  -  )(  ) 

y(  t )J  \  sin  t  cos  t  J  \  y  J 

and  describe  circles  about  the  origin,  in  a  counter  clockwise  direction. 
This  corresponds  to  the  well  known  fact  from  ordinary  game  theory, 


that  the  method  of  repeated  or  ficticious' }  play  need  not  converge 
if  the  contestants  remember  only  the  most  recent  play  of  the  game,  For 
tne-i  tne  loser  always  charges  to  his  other  pure  strategy  before  the 
next  play,  wnile  the  wirner  stands  pat,  and  the  successive  strategy 
pairs  x0’>'0  >  xi  ’  '  i  *  ■■  cycle  about  from  corner  to  corner  of  the 

unit  square  agair  in  a  courter  clockwise  fashion.  Traditionally,  one 
avoids  tms  difficulty  by  having  recourse  to  the  Brown -Robinson  technique, 
whereby  eacn  player  recalls  all  previous  plays  of  the  game,  and  assumes 
tnat  his  opponent  will  choose,  ir.  the  upcoming  play,  that  pure  strategy 
which  he  has  chosen  most  often  m  the  past  But  for  nonzero-sum 
bimatrix;  games,  even  the  Browr.  -  Robinson  technique  does  not  work.  So 
it  seems  doubly  remarkable  that  augmenting  concavity  (blinearity)  with 
the  slightly  stronger  conditions  a  <  0  and  a  <  0  should  so  alter 
the  problem  as  to  render  even  the  much  less  sophisticated  procedure  ir^ 
effective 

Moreover  this  fact  does  not  depend  on  the  dimension  of  the  strategy 
spaces  For  Rosen  [ 3  ]  has  shown  that  every  "strictly  diagonally  concave" 
game  has  a  unique  Nash  equilibrium,  and  that  the  process  we  have  called 
”  converges  to  it.  The  class  of  diagonally  strictly  concave  games 
includes  all  zero-sum  games  (4-7)  for  which  the  n-vector  x  must  be 
chosen  from  a  compact  convex  set  S  in  En  ,  y  from  a  compact  convex 
L  in  Em  ,  and  for  which  the  Jacobian  matrices  $xx  and  are 

negative  and  positive  definite  respectively  Many  other  games  are 
included  as  well  But  we  do  not  wish  to  digress  further  from  the  subject 
of  concave  games  in  the  plane 
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If  the  functions  f  and  g  are  not  polynomials  of  order  two, 
the  equations  (4  1)  are  not  linear,  and  the  curves  c  and  r  are  no 
longer  strainght  lines  So  there  may  be  many  Nash  equilibria.  How¬ 
ever,  near  any  one  of  them,  the  solutions  of  (4.1)  behave  much  as  though 
the  equations  were  linear.  To  see  this,  we  shall  make  use  of  Poincare's 
theory  of  two  dimensional  systems.  This  theory  has  been  considerably 
extended  and  refined  by  Bendixson  and  others,  and  is  admirably  exposed 
in  Lefschetz'  book  [2]. 

Let  ( ::  ,  y  )  be  a  point  of  C  0  r  •  Then  in  terms  of  the  new 
o  o 

variables  £  =  x-xq  and  t]  =  y-yQ  ,  the  equations  (4.1)  may  be  rewritten 

£  =  a  £  +  br,  +  f  *(  £  ,  ) 

(t.io) 

T)  =  e  £  +  ctT\  x  g*(  £ ,  Tj) 

providing  that  f  and  g  have  at  least  continuous  third  order  partial 
derivatives  near  (xQ,yo).  Here  a  -  fxx(x0--V0)  »  b  =  fXy(xo'yo'’ 

3  --  gxy(Xo»yo)'  and  a  =  9yy(xo,yo),  so  that  a  <  0  and  a  <  O  . 

The  right  hand  sides  of  (4.10)  are  the  leading  terms  of  the  Taylor  ex¬ 
pansions  of  f  and  g  about  (xQ,yo).  The  functions  f*  and  g*  are 
the  remainder  terms  in  those  expansions,  and  satisfy 

(4.11)  lim  ^—LLj.R'1  _  o  and  lim  _  q 

T*  r*  7 

r — 5>  0  r— >  0 

2  2  — 

where  r  -  (£  +  t|  ) 2  is  the  distance  from  (£,n)  to  (xo,yQ)  .  The 

constant  terms  in  the  expansions  do  not  appear  because  l^and  g^  vanish 

at  (x  . y  )  . 
v  o  1  o 

Under  the  above  assumptions  (namely  that  f  and  g  are  of  class 
C  ),  we  may  conclude  (see  [2],  pg .  177),  that  the  remainder  terms  have 
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have  but  a  negligible  effect  m  the  immediate  vicinity  of  (x0>yo)> 

and  hence  that  X0,V’0  1S  a  sacldle  point  of  the  system  (,  ^.1)  if 

the  characterist  ic  equatio-  ,  ^  has  a  positive  real  root,  a  stable 

node  if  there  are  two  regative  real  roots,  and  a  spiral  point  if 

both  roots  are  complex.  Or.  since  ia,b)  and  (  b  ,  a )  are  normal 

vectors  to  the  carves  C  and  i  at  !  x  ,y  ),  we  may  summarize  by 

o  o 

saying  that  tne  equilibrium  at  ( xq . y  }  is  stable  if  the  angle  0 
t*-'A/-rr  and  v' ,  >)  is  negative,  and  unstable  (a  saddle  point) 

if  t»  is  positive 

But  if  C  ard  r  are  no  longer  straight  lines,  it  is  also 
possible  for  them  to  meet  tangentially'  In  this  case  0  is  zero,  and 
one  of  the  roots  of  b)  vanishes  Then  the  other  root  must  be 
\  am  c  0  .  So  by  a  theorem  of  Bendixscn,  (see  [2],  pg.  230)  we 
may  conclude  that  a  point  (xo,yo;  ax  which  C  and  r  meet  and  share 
a  common  tangent  is  either  a  .node,  a  saddle  point,  or  a  third  confi¬ 
guration  consisting  (in  Lefschetz  terminology)  of  "two  hyperbolic 
sectors  and  a  fan".  The  latter  configuration  is  sketched  below. 


The  two  "hyperbolic  sectors"  are  the  regions  immediately  above  and 
below  the  distinguished  solution  ,  which  are  filled  with  curves 

which  approach  either  S-  or  S2  as  t  becomes  infinite  The  "far." 
is  the  region  across  S U  from  ,  so  named  because  all  the 

solutions  m  it  eminate  from  the  origin  (they  are  all  tangent  to  C 
and  f  .  crigirally),  and  "far.  out"  to  fill  the  right  half  plane. 
Moreover,  the  "indices”  of  the  three  types  of  equilibrium  are  1,  -1, 

and  0  so  that  the  index,  serves  to  distinguish  the  various  possibilities 
The  index  of  an  isolated  singularity  (equilibrium/  ,  xq( y  )  of 
the  system  ( 1+  1)  about  a  particular  oriented  rectifiable  Jordar.  curve 
j  surrounding  (x0>*0)  1S  defined  by 


(4.12) 


and  has  the  value  (p-n)/2  ,  where  p  is  the  number  of  times  the  field 

vector  f  (x(t),  y(t)),  g  (  x(  t ) ,  y\  t ) )  crosses  the  'upward)  vertical 
x  y 

ray  thru  (x(t),y(t)),  as  the  point  (x(t),yvt))  describes  the  curve 
j  once  in  the  positive  direction,  and  r.  is  the  number  of  times  it 
crosses  in  the  negative  diiection  It  is  clear  from  the  expression 
(1+..  12)  that  Index  J  is  a  continuous  function  of  the  curve  J  ,  which 
takes  on  only  integer  values,  and  hence  must  be  independent  of  J  . 

It  is  easy  too,  to  show  ( see  [2],  pg  186)  that  if  the  deter¬ 
minant  A  =  aa  bp  is  not  zero,  the  index  of  the  equilibrium  point 
(xo,yQ)  of  the  system  (i.10)  is  the  same  as  it  would  be  if  f*  ar.d 
g*  were  identically  zero,  that  is  1  for  a  node  or  a  spiral  point 
and  -1  for  a  saddlepoint  Thus,  finally,  we  may  determine  the  nature 
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stability  of  a  gi-'e.n  eq  1  librium  po  1  t  from  f  ue  -  earby  be.navio;  of 

the  curves  C  ad  ,  alo  e  For  if  .  crosses  C  from  top  to 

bot'cm  i'  toe  direction  c:  icreasi  q  x  at  x  v  I,  toe  lrdex  of 

O  •  G  ‘ 

x  y  is  1  and  tne  eq.iln-riwt.  is  stat.  le  ei'ner  a  node  or  a 

spiral  pci:  f  Or  i r  i  crosses  C  from  bottom  tc  top,  the  index 

is  1  and  tne  eq.ilirri.im  is  .-stable  a  saddle  poi.'t).  And  if 
r  aoes  not  cress  C  but  c  1,  strikes  it  targe:  tially,  the  index  is 
zero  a:  a  the  eq  .  1 1 1 ; -r  l  ,.m  is  again  unstable  two  hyperbolic  sectors  and 
a  fan  '  . 

This  completes  cur  disci. ssior  of  local  phenomena  We  have  shown 
that  tne  oenavicr  of  t  he  s ,  s  t  em  <-  1)  -  ear  a.  isolated  equilibrium  is 
completely  determined  b.  tne  man" er  iv  which  fv  e  curves  C  and  f  inter¬ 
sect  there  in  tne  r.ext.  section,  we  snail  co;  sidei  the  multiplicity 
of  equilibria  and  discuss  the  global  behavior  of  the  system  1). 

The  Global  Co.nf  tqur  atiO.u 

In  trder  •  o  di  »s  qlioal  ^uesttors  i*  seems  easiest  to  project 
the  xy  -  pi a;  e  star  eographical ly  o."  t  o  the  Raima?./:  sphere  the  unit,  sphere 
in  x.  z  -  space  with  its  ce  ter  at  0,0,1'.  C  and  ,  then  map  or.tc 
regular  c..rvos  or  the  sphere  which  we  shall  also  call  C  ar.d  f  ,  ar.d 
which  meet  at  tne  North  Pole  0,0,  Thus  the  point  at  -v  must 

also  be  regarded  as  a?  equilibrium  point  of  the  game  G  C  is  row 
ncmeomcrpnic  »c  a  circle  So  it  makes  se-se  to  say  that  or.e  equili¬ 
brium  pci-  t  "separates  two  others,  meaning  of  course  that  it  lies  on 
tne  segment  cf  C  cut  off  b>  them,  which  does  rot  ccr.tair.  the  North 
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Pole  Also  we  may  speak  of  toe  1  reig.noois'  c:  a  given  equilibrium 
Pcir.t,  bi  i^h  we  snail  mean  these  nearest  *  o  it  cr  e 1 1 n o r  siue 

along  C  Clearly,  a  giver,  equilibrium  may  fail  >c  nave  a  neighbor 
V  Otn.er  that.  NP )  o-  either  or  ;.-otr  sides*  alrhc.gr  k  the  latter 
case,  it  will  be  the  cnl.  eq..  ilibr i_m  point  whim  tne  game  G  possesse 
Next,  let  s  ass  -me  t . . a t  c  a'  1  a  c  *  .  a  1  1  cress  cue  another 
svei V  time  tney  meet.  Tre-.  it  ,  crosses  C  from  bottom  to  top  at  a  point 
E  y  must  cress  from  top  tc  bot  t cm  at  earn  or  E  s  r  eigr.bors  Trv.s 
tne  neighbors  ot  an  <. ratable  equilibrium  1:  a-  ;  must  be  stable  And 
similarly",  tr.e  neigrbors  or  a  stable  equilibrium  are  unstable.  From 
this  fact  alone,  we  car.  completely  describe  tne  qualitative  behavior 
of  the  solutions  of  1)  for  mar.,  games 


Let  us  begir  by  assuming  that  <p ' '  / ,  a  d  y  x;  are  both 
positive  everywhere,  ard  let  us  examine  the  solutions  -ear  an  unstable 
equilibrium  E  ,  flanked  by  its  two  neighbors  E’  an d  E*  .  The 
situation  is  indicated  ir  figure  10  Here  E  has  been  chosen  as  tne 
ongi.i  cf  coordinates,  and  the  ar  rows  indicate  t .'  a  t  tire  directin',  field 


C 


Figure  10 


is  r.or  1  zo.-.tu  l  along  !  ,  pointing  toward  C  ,  and  vertical  on  C  , 

poi't.’ng  toward  r  Tons  the  regions  between  C  and  r  (labeled 
R  and  R'  n  t.ne  figure'  are  filled  with  solutions  of  positive 
sLope,  which  are  directed  awa,  from  E  Ir.  fact,  since  E  is  a 

saddle  pon.t  ,  the  solutions  .near  E  can  only  be  slightly  deformed 

versions  of  those  in.  figure  o  In  particular,  the  separatices 
a.od  .  ’  m^st  though  they  are  no  longer  straight  lines)  lie  in 
R  ad  R ‘  respectively,  while  the  incoming  separatrices  must  lie, 
o: e  eac.o  m-  the  second  and  fourth  quadrants 

Every  solution  of  (4  1)  which  passes  thru  a  point  of  R+ 
converges  to  E 4  as  t  becomes  irfinite.  And  in  particular,  since 
*  ‘  contains  points  of  R1  ,  y  1  must  converge  to  E+  .  To  see  this 

let  K  be  a  circle  about  E+  which  does  not  surround  E  .  Let  A 

and  B  be  the  points  of  intersection  of  K  with  C  and  r  ,  respec¬ 
tively.  and  observe  that  the  field  vectors  at  points  of  K  n  R+ 
all  po  ..ut  into  K  .  And  the  same  is  true  on  any  smaller  circle  as 
well.  Thus  no  solution  that  meets  the  curvilinear  triangle  E+AB 
ma>  ever  again  leave  it  And  in  this  case  (see  [2],  pg  202),  every 
such  solution  must  tend  to  the  vertex  E+  of  the  triangle.  The 
assertion  concerning  follows  by  taking  successively  larger 

circles  K 

If  E  has  no  neighbor  on  the  right,  then  the  image  of  on 

the  Re  imam  sD’nere  must  remain  between  C  and  r  ,  and  converge  to 
NP  as  t.  becomes  infinite  To  see  this,  let  P  be  a  point  on 

.  which  lies  m  R1  ,  and  let  KP  be  the  circle  about  E  which 
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passes  thru  P  Balance  a  unit  sphere  on  E  ,  and  project  the 
plane  stereograph ical ly  onto  it  Then  project  the  sphere,  along 
rays  emanating  from  E  ,  onto  the  plane  Z---2  The  x  and  y  axes 
in  the  original  plane  will  then  map  onto  new  x  a--d  y  axes  in 
z=2  ,  with  NP  as  origin  C  and  r  will  map  onto  a  pair  of  curves 
which  lie  m  the  first  quadrant,  and  whicn  meet  at  NP  And  if  we 

again  use  A  and  B  to  denote  the  points  of  intersection  of  KP 
with  C  and  f  ,  we  again  have  a  curvilinear  triangle  NPAB  which 
7 4  enters,  and  m  which  all  solutions  tend  to  a  single  vertex, 
namely  NP 

Finally,  by  using  the  negative  x  and  positive  y  axes  in 
the  roles  of  C  and  r  ,  and  replacing  the  time  parameter  t  by  -t 
in  the  system  (4  1),  we  may  repeat  the  above  argument  to  show  that 
the  other  two  separatrices  (the  ones  which  end  at  El  must  tend 
to  NP  as  t  approaches 

Thus  a  game  with  2r.  equilibrium  points,  at  each  of  which 
C  and  r  really  cross,  must  have  exactly  n  saddle  points  And 
if  C  and  r  have  everywhere  positive  slopes,  the  separatrices 
which  connect  the  saddle  points  tc  NP  partition  the  plane  into 
njl  strips,  of  which  all  but  one  contain  a  single  stable  equili¬ 
brium.  The  situation  for  r,  =  2  is  indicated  schematically  m 
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Figure_ll 


Here  we  have  taker  all  of  the  equilibria  to  lie  on  a  single  great 
circle  in  the  Reimar.r.  sphere,  which  also  passes  thru  NP  ,  and 
shown  only  or.e  of  the  hemispheres  so  formed.  Region  (1)  corres¬ 
ponds  to  a  semi  -  infinite  strip,  cut  off  by  the  separatnces  joining 
NP  to  the  unstable  equilibrium  -  It  contains  no  stable  equili¬ 

brium.  Region  (3)  is  also  semi- infinite,  and  is  cut  off  by  the 
separatrices  from  NP  to  .  It  contains  the  single  stable  equili¬ 

brium  S0  .  Region  (2)  comprises  the  rest  of  the  plane  (sphere), 
and  contains  . 

The  disparate  roles  played  by  the  stable  and  unstable  equilibria 
under  conditions  of  uncertainty  are  now  clear.  The  stable  equilibrium 
points  are  the  strategy  pairs  toward  which  the  players  will  be  driven 
if  they  follow  the  procedure  of  continuous  experimentation  and 
strategy  modification  outlined  earlier,  while  the  unstable  ones 
serve  to  partition  the  plane  into  regions  from  which  the  various 
stable  equilibria  may  be  reached  Thus  if  the  players  begin  the 
game  G  by  playing  a  strategy  pair  (X0;Y0)  in  Region  (1),  and 


thereafter  alter  their  strategies  according  to  tne  rules  » 1),  they 

will  be  led  m  time  to  play  strategies  apprcximat lr g  x  y  -  . 

But  if  they  start  lr  \2)  or  \j)  tne,  will  be  led  eventually  to  play- 

near  S-,  cr  S  And  only  if  they  start  or,  ore  of  the  separatnces 

joining  NP  to  U,  or  U  will  ’hey  be  led  to  a r>  otter  strategy 

pairs  The  situation  for  larger  r  is  of  course  similar,  but  there 

are  mere  strips  and  more  stable  equilioria 

Finally,  there  are  two  ways  we  can  make  up  a  game  with  2n-l 

equilibria  from  one  with  kn  without  violating  our  assumption  that 

C  and  r  always  cross  when  they  meet  We  car.  add  ar  ex'-  ra  stable 

equilibrium  S  between  U.  and  NP  .  or  we  can  add  ar.  extra  unstable 
^  o  1 

one  tJ  .  between  S  and  NP 
ml 

Of  course,  we  can  always  add  ar.  arbitrary  number  of  equilibria 
at  which  C  and  f  meet  but  do  not  cross,  between  any  pair  of  neighboring 
equilibrium  points  at  which  they  do  cross.  But  it  is  our  feeling  that 
such  equilibria  are  less  important  than  the  other  kinds,  because  they 
would  never  be  observable  in  practice  So  we  shall  term  rhem 
’inessential,"  and  confine  cur  attention  to  games  having  only  essential 
equilibrium  pouts. 

The  reason  that  inessential  equilibria  can  never  be  observed, 
of  |ourse,  is  that  in  reality  we  can  perform  only  f i;  ire  experiments 
So  the  functions  f  and  g  car.  only  be  approxima tel y  known,  and  it  can 
never  be  determined  whether  the  curves  C  and  y  actually  meet  at  a  point 
with  out  crossing,  or  just  lie  very  close  one  another  there  in  ar.y 
case,  we  shall  not  discuss  inessential  equilibria  further 


Our  results  th-s  tar  show  that  »he  qualitative  properties  of  the 
sol'jtiors  of  •  I  .  fcr  a  particular  game  G  ,  are  completely  determined* 
by  me  number  of  stable  a.nd  unstable  equilibria  G  has,  provided  that 
a'  the  equilibria  are  all  essential  and  (b)  that  C  and  r  are  the 
grapns  of  increasing  functions  The  latter  would  be  the  case,  for 
irstar.ce  m  ary  market  game  of  me  sort  considered  in  §1  ,  if  it  were 
know:  tnat  whenever  firm  X  increases  its  price  from  pQ  *o  p^  ,  the 
■ ew  optimal  price  q^  >n  P^ )  fox  Y  ;s  higher  than  the  old  optimum 

qo  *  P0- 

There  are,  of  course,  many  interesting  games  for  which  fb)  does 
r, or.  hold.  And  we  should  like  very  much  to  obtain  the  complete  phase- 
portraits  for  these  games  as  well  But  without  (b),  or  something  to 
replace  it  there  is  .no  apparent  reason  that  the  separat  rices  emanating 
from  ar.  unstable  equilibrium  E  (  see  Figure  10)  must  end  at  the  neigh¬ 
bors  E 4  ar.d  E  of  E  ,  rather  than  at  any  other  equilibria.  Indeed 
it  is  not  even  clear  that  they  must  end  at  stable  equilibria,  although 
we  have  been  unable  to  produce  an  example  for  which  they  do  not  So 
it  is  our  conjecture  that  the  number  of  possible  global  configurations 
grows  rapidly'  with  r;  and  is  probably  too  large  to  allow  for  a  simple 
enumeration  like  the  one  we  have  obtained  above  under  assumption  (b) 

In  any  event,  we  shall  leave  our  discussion  of  global  behavior  at 
this  point,  and  turn  to  other  matters 

For  we  have  determined  what  Lefschetz  I  ’  calls  the  "complete 
pnase  portrait"  of  the  system 
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But  first  we  should  like  to  argue  briefly  that  properties  such 
as  I- stability  are  the  "right"  or.es  to  study.  For  there  is  no  reason 
why  X  might  not  adjust  x(t)  by  solving  x  =  2  £  instead  of  the 
system  { 1).  And  m  general,  X  might  choose  a  "scale  function" 
r(x,y)  while  Y  chooses  p(x,y),  so  that  the  strategy  pairs 
( x( t ) .  y(  t)  )  would  satisfy 

x  =  r(x,y)  fx(x,y) 

(5  1) 

Y  =  t(x,y)  gy(x,y) 

But  our  results  are  not  affected  by  this!  For  all  we  have  established 
about  the  system  (4.1)  follows  from  the  assumptions  (a)  and  (b) 
on  the  rational  curves  C  and  r  ,  which  are  unchanged  by  the  intro¬ 
duction  of  the  scale  functions  r  and  p  .  In  our  view,  this  observation 
adds  greatly  to  the  "robustness"  of  our  conclusions 

6 . _ Rational  Processes 

In  addition  to  the  processes  tt  ,tt  ,  and  v  discussed  earlier, 

Li  o  X 

there  is  at  least  one  other  process  which  deserves  mention.  This  we 
may  call  the  "discrete  rational  process",  because  of  the  essential 
use  it  makes  of  the  rational  curves  C  and  r  •  To  employ  it,  one 
player  (say  X)  names  a  strategy  xQ  ,  and  allows  Y  to  choose  his 
optimal  strategy  yQ  =  ty(xQ)  against  it.  X  then  names  a  second 
strategy  ,  differing  from  xq  by  no  more  than  c-  ,  such  that 

f(x^,  ty(x^))  >  f(  xq,  i|f(xQ))  .  The  process  terminates  when  x  can 
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r.o  longer  find  an  x  ,  such  that  f(  x  ,  i|/(x  ,  ) )  >  f(  x  ,  i|r(  x  )  ) , 
a^d  in  that  case  (xn?  'Kx  ))  is  obviously  an  equilibrium  point  for 
the  game  G  .  We  denote  the  above-described  process  by  the  symbol 

.  A  typical  process  path  consists  of  the  line  x  =  xq  ,  plus 

a  polygonal  approximation  to  a  portion  of  r  ,  leading  from  the  point 

wnere  x  =  xq  meets  r  ,  to  some  stable  equilibrium  point  E  .  We 

shall  sketch  a  proof  of  this  fact  shortly.  But  before  we  do,  we  wish 

to  point  out  that  tt  also  has  an  inf initessimal  analogue  it  . 

This  inf initessimal  process  consists  simply  of  a  straight  line 
begirning  somewhere  on  x  =  xq  ,  followed  by  a  curve  which  follows 
along  r  in  the  direction  of  increasing  f( x,  ^(x))  .  And  it  too 

C 


always  converges  to  a  stable  equilibrium.  To  see  that  this  is  so, 
observe  that,  as  shown  in  Figure  12,  there  is  a  well  defined  direction 
of  increasing  f(  x,  \|<(x))  at  every  point  ( x,  ty(x))  of  r  that  is 
r.ot  also  a  point  of  C  .  For  if  we  consider  such  a  point  of  r  ,  and 
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recall  that  the  field  vector  {  f  i  x, »( x) ) ,  g  tx,t'!x))  is  horizontal 

x  y 

there,  it  is  clear  that  the  vector  may  be  resolved  into  components 

vhich  are  respectively  normal  and  tangential  to  r  .  And  furthermore, 

the  tangential  component  cannot  vanish  unless  either  the  whole  field 

vector  (f  ,g  )  vanishes,  or  f  is  vertical  at  t  x,  v|  x)  )  .  But  we 
x  Y 

saw  in  §3.  that  r  is  never  vertical,  and  that  the  field  vector 

vanished  only  on  C  0  r  .  Thus  the  component  of  (f  ,g  )  which  is 

x  y 

tangent  to  r  may  vanish  { -i  e,  change  direction)  only  when 
(x,t(x))  crosses  C 

Finally,  the  field  vector  (f  ,g  )  must  point  toward  the  stable 

x  y 

equilibrium  E  in  all  sufficiently  small  neighborhoods  N'E)  .  And 
so,  therefore,  must  its  tangential  component,  at  pomes  of  r  n  N  VE). 
But  if  that  component  can  change  direction  only  at  points  of  C  n  r  , 
it  must  continue  to  point  along  r  toward  E  ,  not  only  in  N  (E), 
but  also  at  all  points  of  r  between  the  neighbors  E  and  E  of 
E  .  This  completes  the  proof  that  the  process  v  (X)  must  converge 
to  a  stable  equilibrium  point  of  G  ,  unless  the  line  x  =  xq  passes 
thru  an  unstable  equilibrium.  In  that  case,  the  process  consists  of 


a  segment  of  x  =  x^  only,  and  converges  to  the  unstable  equilibrium 
which  lines  thereon. 


Similar  remarks  can  of  course  be  made  for  ir  ( Y )  ,  and  the 

RI 

corresponding  convergence  proofs  for  the  methods  n  ( X ; *  )  and 

R 

7T  (  Y ;  c  )  follow  from  the  fact  their  process  paths  lie  within  c -neigh- 
R 

borhoods  of  the  v  paths  We  point  out  too  that  methods  quite 

Rl 

similar  to  the  methods  v  have  beer,  used  with  some  success  [U!  to 

R 

compute  optimal  pursuit  and  evasion  strategies. 


Most  of  the  classical  work  in  game  theory  has  assumed  that  the 
strategies  x  ar.d  y  were  to  be  chosen  from  compact  convex  sets  X 
and  Y  ,  In  our  case,  these  must  each  be  contained  in  R  ,  so  we  may 
as  well  lake  them  loth  to  be  the  unit  interval  I  =  [0,1].  And  we 
shall  refer  to  the  game 

[G  )  max  f  ( x ,  y )  max  g(x,y) 

1  x  l  ye  I 

as  the  "restriction  of  G  to  Ixl'  ,  or  simply  "the  restriction  of  G". 

Clearly,  any  points  of  C  fl  F  which  happen  to  lie  in  Ixl  are 
equilibrium  points  of  Gj  as  well  as  of  G  .  But  G ^  may  have  other 
equilioria  as  well.  We  may  call  them  "induced  equilibrium  points", 
as  opposed  to  the  "natural  equilibria"  which  lie  in  C  n  r  .  The 
induced  equilibria  may  be  of  several  types. 

To  begin  with,  r  must  cross  each  of  the  lines  x  =  0  and 

x  1  exactly  once,  say  at  (0,y  )  and  at  (l,y^)  .  If  0  <  yQ  <  1, 

and  0  ^  y^  ^  1  ,  these  points  are  possible  equilibria.  To  test 
( 0 , y  ) ,  observe  that  C  must  cross  the  line  y  =  yQ  at  a  point 
(x  ,yQ1,  and  that  (0,yQ)  is  an  induced  equilibrium  point  of  Gj 
if  and  only  if  xQ  <  0  ,  or  equivalently,  if  f  (0,y  )  <  0  .  It  is, 
of  course,  a  natural  equilibrium  if  xQ  =  0  ,  and  it  is  not  an  equili¬ 
brium  if  xq  0  .  Similarly,  to  see  if  (l,y^)  is  an  induced 
equilibrium  point,  let  (x^y^)  be  the  point  where  C  meets  y  =  y^  . 
Then  if  x^  _  1,  (l,y^)  is  an  equilibrium  point  of  Gj  .  No  other 

equilibria  can  lie  on  the  vertical  sides  of  Ixl,  save  possibly  at 


the  corners. 


There  are,  similarly  at  most  two  possible  eq.ii  1  ibr  rum  points 
or  the  horizontal  sides  of  Ixl,  a- d  these  may  also  be  tested  ir  a 
straightforward  mar:  er  Either,,  both,  or  neither  may  tarn  out  actuall 
to  be  equilibria 

If  yQ  <  0  then  (0,0  out  not  0,1*  may  be  an  equilibrium 

point  To  test,  lock  at  the  poir.t  x^O  at  wmcn  C  crosses 

y  0  .  If  x  <  0  ,  then  (0,0,  is  a*,  equilibrium  Otherwise  it 
*o  o  - 

is  r.ot  ,  Similar  tests  may  be  performed  at  the  other  corners 

Thus  Gj  may  have  at  mosr  fo  r  induced  equilibria;  no  more  than 
one  may  lie  c;u  a  single  side  ir,  fact  ,  there  may  never  be  more  than 

two  For  suppose  that  three  'say  the  top,  bottom,  and  left)  sides 

of  ixl  contain  distinct  equilibria  Then  : either  0,0  nor 

(0,1)  is  an  equilibrium  So  there  must  be  equilibria  at  (xq,0.) 
and  (x^,l)  ,  where  both  xq  and  x^  are  positive.  Arid  if  so,  the 

points  (xo,yQ)  ar.d  (x^,y^)  at  which  ,  meets  the  lines  x  =  xq 

and  x  -  x^  must  lie  below  and  above  Ixl  ,  respectively  Put  f 

must  also  pass  thru  the  equilibrium  point  (0,y*)  which  lies  on  the 
left  side  of  Ixl  Hence  r  must  eitner  cross  the  line  x  =  0 

twice,  or  be  tangent  to  it  at  (  0 ,  y  *  )  .  And  either  of  these  possi¬ 
bilities  would  contradict  the  fact  that  g  <  0  «  The  reader  is 

yy 

invited  to  construct  examples  having  1  and  d  induced  equilibria. 
How  many  stable  and  unstab1 e  natural  equilibria  must  such  examples 
posess?  And  car,  an  induced  equilibrium  point  ever  oe  unstable? 


We  intend  to  return  to  these  ar.d  related  questions  at  a  later 
date  But  for  the  moment,  we  are  content  tc  suppose  that  we  have 
revealed  something,  perhaps  quite  unexpected,  about  the  set  of  Nash 
equilibrium  points  cf  a  game  ar.d  the  relative  ease  with  which  they 
may  be  computed.  And  we  hope  that  others  will  try  che  methods  we 
have  recommended  (especially  the  rational  processes  n  ,  for  which 
we  have  great  hopes),  and  find  them  useful.  For  we  expect  that, 
particularly  for  games  with  imperfect  information,  they  are  both 
natural  methods  to  try,  and  as  likely  as  any  to  achieve  success. 


APPENDIX:  We  present  a  proof  of  the  lemma  in  Section  3.  The 

condition  (  5 . c' )  guarantees  ti  t  tQ  and  t^  exist  (perhaps  ±  ^  ) 

and  that  for  sufficiently  small  positive  t  we  have  h(t)  <  t  and 

h(-t)  -t  .  Since  h(t)  f  t  for  all  t  c  I  U  I +  ,  part  (  i)  is 

proved  for  n  1  .  A  similar  argument  shows  that  h(h(t))  <  t  if 

t  I4  and  h(h(t))  t  if  t  c  I 

We  now  show  h( t  )  t  or  h(  t  )  =  t.  .  By  the  definition  of 

v  o  o  v  o  1  1 

t  we  have  h(tQ)  (  I  If  h(tQ)  <  tQ  then,  by  the  continuity  of 

h(t)-t  ,  there  exists  t  0  I  for  which  h(t)  =  t  ,  a  contradiction. 

So  h(  t  )  tQ  or  h( tQ)  _  t^  and  similarly  h(t^)  =  t^  or 

h  t  •  Suppose  h( tQ)  Then  there  exists  t'  e  I  for 

which  h(t')  t^  .  If  h(t^)  t1  then  h(  h(  t '  ) )  =  h(  t '  )  ,  a 
contradiction;  on  the  other  hand,  if  h( t^ )  <  tQ  then  h(h(t'))  <  tQ <  t ' 
so  that  by  the  continuity  of  h(h(t))-  t  there  exists  t"  c  I  for 
which  h(h(t"))  t"  ,  a  contradiction.  This  proves  part  (ii). 


-  - 


Suppose  there  exists  tel  for  which  h(  t  t  .  By  part  f i' 
with  r  1  .'e  have  tel  •  If  h(  tQ)  =  t^  then  h  (h(  t ) )  •  t  ,  a 
contradiction;  if  h(  t  !  t^  ,  then  h(h(tj)  =  hft),  a  contradiction. 

A  similar  argument  shows  we  cannot  have  h(  t)  =  t.,  for  tel.  Hence 
(iii)  is  proved  for  n^l  and  follows  for  general  n  by  induction. 

The  case  n- 1  having  already  been  proved,  we  use  induction  to 


prove  (i)  by  assuming  it  true  for  n 

=  1, 2, . . . , m-1 .  Suppose 

t  r  i + 

ar.d  h^(t)  B  t  . 

if  h[j]; t)  <  o 

for  all  j=l, 2, . . . , m- 1 , 

then 

htm-l](h[m-l](t)) 

hfm-2](t)  <  ht®-13(t) 

,  a 

contradiction ;  on 

the  other  hand,  if 

h^Jft)  >  0  for  some 

j  <  m-1, 

then  t  -  h^ml(t) 

h ^ ( t )  <  t  ,  a  contradiction 

A  similar  argument  holds  for  tel 

To  prove  ( iv)  fix  t  and  consider  the  subsequence 
r  n  .  i  j-  n  -j 

{hL  -IJ(t):  hL  -iJ(t)  >0}.  This  is  a  monotone  decreasing  sequence  and 
hence  converges  to  some  t  >  0  .  Suppose  t  >  0  .  Then  the  subsequence 
is  eventually  in  any  neighborhood  of  t  ,  But  by  the  continuity  of 
h^  ,  if  t  is  in  a  small  neighborhood  of  t,  h^-'(t)  is  in  a  small 
neighborhood  of  h^J(t)  <  t  so  the  subsequence  cannot  remain  in  any 
neighborhood  of  t  .  This  contradiction  proves  that  the  subsequence 
converges  to  Cb  and  a  similar  argument  proves  that  the  complementary 
subsequence  converges  to  0  as  well. 
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